A note on faithful coupling of Markov chains
نویسندگان
چکیده
One often needs to turn a coupling (Xi, Yi)i≥0 of a Markov chain into a sticky coupling where once XT = YT at some T , then from then on, at each subsequent time step T ′ ≥ T , we shall have XT ′ = YT ′ . However, not all of what are considered couplings in literature, even Markovian couplings, can be turned into sticky couplings, as proved by Rosenthal [Ro97] through a counter example. Rosenthal then proposed a strengthening of the Markovian coupling notion, termed as faithful coupling, from which a sticky coupling can indeed be obtained. We identify the reason why a sticky coupling could not be obtained in the counter example of Rosenthal, which motivates us to define a type of coupling which can obviously be turned into a sticky coupling. We show then that the new type of coupling that we define, and the faithful coupling as defined by Rosenthal [Ro97], are actually identical. Our note may be seen as a demonstration of the naturalness of the notion of faithful coupling.
منابع مشابه
Faithful couplings of Markov chains: now equals forever
This short note considers the usual coupling approach to bounding convergence of Markov chains. It addresses the question of whether it suffices to have two chains become equal at a single time, or whether it is necessary to have them then remain equal for all future times. Let P (x, ·) be the transition probabilities for a Markov chain on a Polish state space X . Let μ and ν be two initial dis...
متن کاملMarkov chains and mixing times ( part 2 - coupling )
This week’s post continues last week’s discussion of Markov chains and mixing times, and introduces the idea of coupling as a method for estimating mixing times. We remark that some nice notes on the subject of coupling (and others) can be found on Steve Lalley’s web page – of particular relevance for our purposes here are the notes on “Convergence rates of Markov chains”. A more thorough and c...
متن کاملEmpirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملEvaluation of First and Second Markov Chains Sensitivity and Specificity as Statistical Approach for Prediction of Sequences of Genes in Virus Double Strand DNA Genomes
Growing amount of information on biological sequences has made application of statistical approaches necessary for modeling and estimation of their functions. In this paper, sensitivity and specificity of the first and second Markov chains for prediction of genes was evaluated using the complete double stranded DNA virus. There were two approaches for prediction of each Markov Model parameter,...
متن کاملThe Rate of Rényi Entropy for Irreducible Markov Chains
In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1710.10026 شماره
صفحات -
تاریخ انتشار 2017